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Abstract 

We obtain the analogue of the classical result by Erdos and Kac on the limiting distribution of the 
maximum of partial sums for exchangeable random variables with zero mean and variance one. We 
show that, if the conditions of the central limit theorem of Blum et al. hold, the limit coincides 
with the classical one. Under more general assumptions, the probability of the random variables 
having conditional negative drift appears in the limit. 

Keywords: exchangeable random variables, limit theorem, maximum, de Finetti’s theorem 
MSC: 60G09, 60F05, 60G70 


1. Introduction 


some fundamental results on the distribution 
k v where {X n } ne N is a sequence of 


Erdos and Kac established in 14] 
of the maximum of partial sums Sy : = 
independent, identically distributed (i.i.d.) centered random variables with variance 
one. In particular, they proved that the limiting distribution of n~ 2 maxi <k< n Sk 
is given by (2<h(x) — l)l[ 0 oo )(a:), where <£(•) denotes the probability distribution 
function (p.d.f.) of the standard normal distribution. 

Our interest in studying the (rescaled) maximum of partial sums is motivated by its 
manifold applications. On the one hand, it is directly related to first passage times of 
random walks and renewal theory 0,1 E3 ]. On the other hand, in the classical i.i.d. 
setting, this statistic has since lon g be en employed in numerous research areas such 
as hydrology |j|, reservoir storage [18| and change-point analysis fl9i]. Moreover, as 
a matter of study in extreme value theory, this type of limit theorems are of especial 
relevance, for instance in finance (see 21] and references therein). 


The purpose of this paper is to generalize the original result of Erdos and Kac 
to exchangeable sequences of random variables and thereby extend the mentioned 
statistic to further stochastic models. Exchangeable random variables, introduced 
by de Finetti in [lij, are random variables with the property of being conditionally 
independent. Equivalently, one can think of them as mixtures of i.i.d. random 
variables directed by a random measure. The study of classical results of probability 
theory in the exchangeable setting started with the Central Limit Theorem (CLT) 
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by Blum, Chernoff, Rosenblatt and Teicher in 
L'l I24J ] that continues expanding (see e.g 



and it led to a series of works [2£ 
15l . [27]). Exchangeable random 


variables are of great interest due to their versatility as stochastic models UMM 
and their wide applicability in gen etics 1201]. Bayesian analysis 10y and many other 
branches of statistical analysis 2, 26|, @] . 


The limit theorem considered in this paper contributes to extend results of extreme 
value theory to the exchangeable context. In this direction, Berman obtained in [|j 
the limiting distribution of the maximum of an exchangeable sequence of random 
variables. 


Our results show that, if the classical conditions of the CLT of Blum et al. hold, one 
obtains the original statement of Erdos and Kac in the i.i.d. setting, c.f. Proposi¬ 
tion [T| Dropping off the assumption on the variance of the directing random measure 
gives rise in Theorem [2] to a limiting distribution that, in the non-degenerate case, 
resembles the previous result and involves the distribution function of a mixture 
of Gaussians. Consequently, we discover in Corollary |T] that, when no assump¬ 
tions are imposed to the directing random measure, the limit of the distribution 
of n^ 1 / 2 maxi</ c < ri Sk depends on the conditional drift and the conditional variance 
of the random variables. In particular, we see that the probability of the random 
variables having negative drift makes a substantial contribution to this limit. 

The paper is organized as follows: In Section [2] we fix notation and briefly review 
basic results of the theory of exchangeable random variables. Section [3] is devoted 
to presenting and proving the different generalizations of the limit distribution of 
Erdos and Kac. Finally, these results are furnished with examples in Section [4] 


2. Definitions and auxiliary results 

Let II(n) denote the set of permutations of {1,..., n}. A sequence of random vari¬ 
ables {X n } ne p;j is said to be exchangeable if for any n £ N, X \,..., X n are exchange¬ 
able, i.e., for any permutation ir £ II(n), 

Law(Xi ,..., X n J Laiv(^X n (]^,..., X ^^ n ^). 

Alternatively we write (X\ ...., X n ) = (A^y),..., X n ^). The concept of exchange¬ 
ability was introduced by de Finetti in [12j, who in particular proved that such a 
sequence is conditionally i.i.d. given the ex-field of permutable events. 

An essential tool in our proofs is de Finetti’s theorem. Let 5 denote the collection 
of all p.d.f.s on M with the topology of weak convergence of distribution functions. 
De Finetti’s theorem states that for an infinite sequence of exchangeable random 
variables {X n } ng fsj, there exists a unique probability measure [i on the Borel cr-field 
21 of subsets of £ such that for any n > 1, 

P(g(X u ...,X n )eB)= f P F {g(X 1 ,...,X n )£B) f i(dF) (1) 
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holds for any Borel set B € B(R) and any Borel function g : W 1 —>• M. Here, 
Pp(g(,Xi ,..., X n ) € B ) is the probability of the event under the assumption that 
the random variables X \,..., X n are independent with common p.d.f. F. The 
mean Epg(X\,.... X n ) is obtained by integrating g with respect to the probability 
measure F. Let us now denote by F: H —>• £ a random variable whose probability 
distribution is given by the measure g, from de Finetti’s theorem. The conditional 
mean E?g(Xi,... ,X n ) is defined analogously to Epg(X \,..., X n ) and is itself a 
random variable because the p.d.f. F is random. It should be noted that de Finetti’s 
theorem fails for finite collections of exchangeable random variables. We refer to [1] 
for further details on this subject. 


The law of large numbers (LLN) for exchangeable sequences was established by Hu 
and Taylor in 24], They showed that for an exchangeable sequence { WijneN such 
that Ep|Xi| < oo /U-a.s., 


— S n a ' s ' > 0 as n —» oo if and only if EX\X -2 = 0. (2) 

n 

It is not difficult to see that EX 1 X 2 = 0 is equivalent to EpW = 0 /j-a.s. As already 
mentioned in the introduction, Blum, Chernoff, Rosenblatt and Teicher proved in [6] 
that for an exchangeable sequence with zero mean and variance one the CLT holds 
if and only if 

EXiXj = 0 and EXfXj =1 V i ^ j. (3) 

In general, it is possible to obtain limit theorems for sums of exchangeable sequences 
under weaker assumptions. De Finetti’s theorem can be rephrased (see [l., Theorem 
3.1]) by saying that the infinite exchangeable sequence {Anjngpj is a mixture of i.i.d. 
random variables directed by the random measure F, whose probability distribution 
/r is given in ©• With this notation, 


P F ((*!, ■ ■ ■ ,X n ) G A) = n F (Ai), A = A 1 x---xA n e £>(M n ), 

i=l 

and EpXi = J R xF(dx). Moreover, if E|Xi| < 00 , then the LLN 

— S n a ' s ’ > EfXi as n —>• 00 (4) 

n 

holds (see e.g. [1, p.17]). This directly implies the necessity of ([2]) since EX\X -2 = 0 
means that the directing random measure F has zero mean, i.e. EpAi = 0 /i-a.s. 
Furthermore, we have that if 0 < EXl < 00 , then the CLT 

S n - nE F A! (5) 

V racJ F 

holds, where := Ep(^fi — E^X\) 2 . This formulation generalizes the necessity 
of ([3]) because again F has zero mean and EXfX^ = 1 is equivalent to the fact that 
F has variance one, i.e. Up = 1 a.s. These limit theorems can also be obtained in 
terms of conditional characteristic functions, see [28]. 
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3. Limit theorem for maximum of sums of exchangeable random variables 

In this section, we investigate the limiting distribution of the largest partial sum of 
an exchangeable sequence of random variables. In a first step, this limit is obtained 
under the assumption that the directing random measure F has zero mean and vari¬ 
ance one. Secondly, the variance-one assumption is removed and the corresponding 
limiting theorem is derived. Finally, the latter result is applied to analyze the limit 
of the probability of the maximum of partial sums for a sequence with a general 
directing random measure. 

Let us start by recalling the original result of Erdos and Kac. 

Theorem 1. fl2 l Let {A„.} nG p} be a sequence of i.i.d. random variables with zero 
mean and variance one, and let Sk := Then, 

lim P(max(5i,..., S n ) < xy/n) = G(x), 

n—too 

where G : R —>• R is given by 

G{x) := (2$(s) - l)l [0i oo)(®) (6) 

and $ denotes the p.d.f. of the standard normal distribution. 

A direct extension of this theorem in the exchangeable setting is obtained when we 
assume that the conditions for the classical CLT given in <[3|) are satisfied. 

Proposition 1. Let {X n } n£ ^ be an exchangeable sequence of random variables with 
zero mean and variance one satisfying (|3|). Then, 

lim P(max( t S'i,..., S n ) < xyfn) = G(x), 

n—>oc 

where G : R — >• R is given by ©. 

Proof. Since P^(max(S'i,..., S n ) < Xy/n) is uniformly bounded by one and p is 
a probability measure, applying de Finetti’s theorem, Lebesgue dominated conver¬ 
gence theorem and Theorem Q] to the conditional probability yields 


lim P(max(5i,..., S n ) < xy/n) 

n—>oo 



Pjr(max(5i,..., S n ) < xy/n) n{dF) = G(x). 


□ 


Remark 1. Notice that in fact, every limiting result originally proved by Erdos and 
Kac in 


.14] can be obtained in the same fashion. 
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The next natural step to generalize Proposition |T] consists in considering an ex¬ 
changeable sequence {X„} ne pj whose directing random measure F only satisfies the 
zero-mean condition. From ([5|) we know that 

_L Sn ^Z-a f , (7) 

y/n 


where Z ~ A^(0,1) is independent of up and F has distribution measure // from de 
Finetti’s theorem. Let us now define G ^: M —>• R as 


G^{x) := [ l(o,oo) (cr 2 F )G(x/a F ) n(dF), 

■h 

where G was given ([6]). Then we have the following result. 


( 8 ) 


Theorem 2. Let {X n } n€ N be an exchangeable sequence of random variables with 
zero mean and variance 0 < EXf < oo such that EX 1 X 2 = 0. Then, 

lim P(max(5i, ...,S n ) < xy/n) = P(crp = 0)1[ 0 iOO )(.t) + G^x), (9) 

n —Vnn L ' 


where G^: R —> M is given in (JHJ) and ji is the distribution of the directing random 
measure of the sequence {X n } ne pj. 

Proof. In view of (|7|) . de Finetti’s theorem, Lebesgue dominated convergence theo¬ 
rem and Theorem [T] lead to 


lim P(max(£i,..., S n ) < xy/n) 

00 


= P(dp = 0)l[0 iOO )(x) + / lim l( 0iOO )(<T^)PF(max(5 , i,... ,S n ) < xy/n) n(dF) 


= P(<Tp = O)l[ 0 ,oo)(®) + / 1(0, 00 )(cr 2 F )G(x/a F ) n(dF). 


□ 


Remark 2. Notice that in the exchangeable setting one may encounter sequences of 
non constant random variables with P(cp = 0) > 0 (see Example (21). In particular, 
Theorem [2] shows that if the sequence is non-degenerated in the sense that the 
conditional variance is almost surely positive, i.e. P(crp > 0) = 1, then the limiting 
distribution in ([9]) becomes the mixture 


L 


G[x/ap) (x{dF). 


( 10 ) 


Remark 3. The exchangeable counterparts of the limiting distributions in 14] under 
the assumptions of Theorem [2] can be derived in the same fashion. 
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We conclude this section applying Theorem [2] to investigate the limit of the dis¬ 
tribution of nT 1 ^ 2 maxi<fc< n Sk when no assumptions are imposed to the directing 
random measure of the exchangeable sequence {WijneN- 

Corollary 1. Let {X n } ne ^ be an exchangeable sequence of random variables with 
zero mean and variance 0 < EX 2 < oo. Then, 


lim P(max(5i,..., S n ) < xy/n) 

n—>oo 

= P(E F Ad < 0) + P(E F Ad = 0,Up = 0)l [0iOo) (x) + G'^(x), 
where G ': M R is given by 


G’^x)= I l {0} (E jF Ar 1 )l (0jOO ; )(a 2 F )G(x/a F )ii(dF) 
and G is defined in © . 


Proof. By de Finetti’s theorem, 


P(max(S'i,..., S n ) < xyfn ) = / Pf( max S\ ; < xyfn) / i(dF) 


'?+ 


l<fc<n 


+ / P f( max Sk < xy/n) fi(dF) + Pp( max Sk < xyfn) fi(dF) 


'do 


1 <k<n 


fd- 


1 <k<n 


— • d-n,-\-{x) + -^n,0 (x) + I n) —(x)y 


where 5+ := {i 7 € $\ E fX\ > 0}, £ 0 := {F G £ | E f Xi = 0}, and g- := {F G 
5|E F Xi <0}. 

On the one hand, for any F G 3+, 


Pi?( max Sk < xy/n) < P F (S n — nE F X\ < xyfn) < 

1 <k<n 



nx 2 


which tends to zero as n —>• oo. Lebesgue dominated convergence theorem thus 
yields lim I n ,+ (*) = On the other hand, following the proof of Theorem [2] we 

n—too ’ 

have that 


lim I n 0 (x) 

n—toe 



1 (0,oo) (TF^IOjOo) (x) h{dF) + 



1(0,00)(°r) G(x/a F ) fi(dF) 


P(E f Ai = 0, <t f = 0)l[ 0iOO )(x) + G' IJ (x). 


Finally, if F G gT, the Hayek-Renyi inequality leads to 


n 

Pf( max Sk < xy/n) > 1 — > 

l<k<n 

k =1 




{xyfn — kEpXi) 2 


> 1 - 


<7% 


EpXxXyfn' 


which tends to one as n —» oo. By Lebesgue dominated convergence theorem, 
lim I n -(x) = P(E f Ai < 0) and the result follows. □ 

n—too ’ 
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Remark 4. Notice that the limit appearing in Corollary |Tj is not a distribution 
function unless the assumptions reduce to those of Theorem [2j Thus, convergence 
in distribution holds in PropositionQ]and Theorem[2l but not in the general situation 
of Corollary [TJ 


4. Examples 


We finish our discussion with some examples that furnish the results presented in 
the previous section. 

Example 1. Let {T n }neN be an exchangeable sequence of random variables with 
EY, Y -2 = 0 and EY 2 Y 2 2 = 1 that take values in {—1,1}, and let {Z n } ngF j be a 
sequence of i.i.d. standard normal distributed random variables independent of 
{Y n } ng pj. The sequence 

{^n}n6N := {Y'ri + ^n}n£l 


is exchangeable and the process S n =: Xk may be called exchangeable random 

walk plus noise. This model appears for instance in Bayesian dynamic modeling 
Chapter 8]. For this sequence, EX n = E Y n + E Z n = 0 and 
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EX,X 2 = E(Yi + Z 1 )(Y 2 + Z 2 ) = EY,Y 2 + EY, EZ 2 + EZ 1 EY 2 + EZiEZ 2 = 0. 


Moreover, it is non-degenerate in the sense that 

P(cjp > 0) = P(E f X 1 2 > 0) > P(E f Y 1 2 > 0) = 1, 

and therefore P(crp = 0) = 0. Thus, we can investigate the asymptotic distribution 
of the stopping times 


T n (x) := inf{A: > 1 : > xy/n} 

by studying the asymptotic distribution of the maximum of partial sums Sf ; - Ap¬ 
plying Theorem [2] we get 

lim P(T n (x) < n) = lim P(max(5i,. .., S n ) > x\/n) 

n—too n—too 

= 1 — lim P(max(5i,..., S n ) < xy/n) 

n—too 

= 1 - G^x), 


where G M is given by (flOl) . 

As pointed out in Remark (2] it is possible to have an exchangeable sequence of non 
constant random variables with P(crp = 0) > 0. The following example illustrates 
how this situation may arise in applications. 
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Example 2. In financial modelling, the risk of a financial asset can be represented 
by a sequence {£ n }neN of i.i.d. real-valued random variables, for instance with 
zero mean and positive variance <r 2 > 0. The quantity maxj<fc< n ^( c =1 Ci thus 
expresses the maximal loss over a certain period. Exchangeable models appear in 
this setting for instance by introducing an independent default indicator Y such 
that P(y = 1) = 1 — P(T = 0) = p, p € (0,1). In this case, the sequence 

{T re }ngN ■— {y£n}nSN 

is exchangeable with EX\ = p E£i = 0 and EX 2 = p E£ 2 = pa 2 >0. This example 
is especially illustrative because it is possible to verify Theorem [2] by calculating the 
limiting probability of the maximal loss directly. Since are i.i.d. we have that 
EX iX 2 = ET 2 £i6 =p E£i& = P(E6) 2 = 0 and EX 2 X 2 = E = pEgg > 0, 

which might not necessarily be one. 

For the partial sums S n := ^” =1 A*, the limiting probability 

lim P(max(5i,..., S n ) < xyfn) 

n—>00 

can be obtained as follows: Let S n := £fc- By conditioning on Y and applying 

the classical result of Erdos and Kac to S n /a we have that 

lim P( max Sk < xy/n) = pG(x/a) + (1 — p)l\ 0 ^(x). 

Let us now see that this coincides with the limiting expression in our Theorem. In 
this case, the directing measure F is discrete and takes the values F\ and F 2 with 
probability p and 1 — p respectively, and 

{ £ n under F\. 

0 under F 2 , 

for each n € N. Thus, Ep^X\ = E^i = 0 = Ep 2 X 2 and var^ X\ = er 2 , varp 2 Xi = 0. 
In particular X\ = 0 under F 2 , hence 

P(E f X! = 0 , 4 = 0) = P(F = F 2 ) = 1-p 


and 


Gp(x) = I l {0} (E F Xi)l( 0jOo) (a 2 F )G(x/a F ) n(dF) =pG{x/a) 


as desired. 
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